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Abstract 

In wireless packet-forwarding networks with selfish nodes, application of a repeated game can induce 
the nodes to forward each others' packets, so that the network performance can be improved. However, 
the nodes on the boundary of such networks cannot benefit from this strategy, as the other nodes do not 
depend on them. This problem is sometimes known as the curse of the boundary nodes. To overcome 
this problem, an approach based on coalition games is proposed, in which the boundary nodes can use 
cooperative transmission to help the backbone nodes in the middle of the network. In return, the backbone 
nodes are willing to forward the boundary nodes' packets. Here, the concept of core is used to study 
the stability of the coalitions in such games. Then three types of fairness are investigated, namely, min- 
max fairness using nucleolus, average fairness using the Shapley function, and a newly proposed market 
fairness. Based on the specific problem addressed in this paper, market fairness is a new fairness concept 
involving fairness between multiple backbone nodes and multiple boundary nodes. Finally, a protocol is 
designed using both repeated games and coalition games. Simulation results show how boundary nodes 
and backbone nodes form coalitions according to different fairness criteria. The proposed protocol can 
improve the network connectivity by about 50%, compared with pure repeated game schemes. 
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I. Introduction 

In wireless networks with selfish nodes such as ad hoc networks, the nodes may not be wilUng to 
fully cooperate to accomplish the overall network goals. Specifically for the packet-forwarding problem, 
forwarding of other nodes' packets consumes a node's limited battery energy. Therefore, it may not be in 
a node's best interest to forward other's arriving packets. However, refusal to forward other's packets non- 
cooperatively will severely affect the network functionality and thereby impair a node's own performance. 
Hence, it is necessary to design a mechanism to enforce cooperation for packet forwarding among greedy 
and distributed nodes. 

The packet-forwarding problem in ad hoc networks has been extensively studied in the Uterature. The 
fact that nodes act selfishly to optimize their own performance has motivated many researchers to apply 
game theory [1], [2] in solving this problem. Broadly speaking, the approaches used to encourage packet- 
forwarding can be categorized into two general types. The first type makes use of virtual payments. Pricing 
[3] and credit based method [4] fall into this first type. The second type of approach is related to personal 
and community enforcement to maintain the long-term relationship among nodes. Cooperation is sustained 
because defection against one node causes personal retaliation or sanction by others. Watchdog and 
pathrater are proposed in [5] to identify misbehaving nodes and deflect traffic around them. Reputation- 
based protocols are proposed in [6] and [7]. In [8], a model is considered to show cooperation among 
participating nodes. In [9], the question of whether cooperation for packet forwarding can exist without 
incentive mechanisms is answered using game theory and graph theory. Packet forwarding schemes using 
"TIT for TAT" schemes are proposed in [10]. In [11], a cartel maintenance framework is constructed 
for distributed rate control for wireless networks. In [12], self-learning repeated game approaches are 
constructed to enforce cooperation and to study better cooperation. Some recent work applying game 
theory to enhance energy-efficient behavior in infrastructure networks can be found in [13]-[16]. 

However, packet-forwarding networks are plagued by the so-called curse of the boundary nodes. The 
nodes at the boundary of the network must depend on the backbone nodes in the middle of the networks 
to forward their packets. On the other hand, the backbone nodes will not correspondingly depend on the 
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boundary nodes. As a result, the backbone nodes do not worry about retaliation or lost reputation for 
not forwarding the packets of the boundary nodes. This fact causes the curse of the boundary nodes. In 
order to cure this curse, in this paper, we propose an approach based on cooperative game coaHtions 
using cooperative transmission. 

Recently, cooperative transmission [17] [18] has gained considerable attention as a transmit strategy 
for future wireless networks. The basic idea of cooperative transmission is that relay nodes can help a 
source node's transmission by relaying a replica of the source's information. Cooperative communications 
efficiently takes advantage of the broadcast nature of wireless networks, while exploiting the inherent 
spatial and multiuser diversities. The energy-efficient broadcast problem in wireless networks is considered 
in [19]. The work in [20] evaluates the cooperative diversity performance when the best relay is chosen 
according to the average signal-to-noise ratio (SNR), and the outage probability of relay selection based 
on instantaneous SNRs. In [21], the authors propose a distributed relay selection scheme that requires 
limited network knowledge with instantaneous SNRs. In [22], the relay assignment problem is solved for 
multiuser cooperative communications. In [23], cooperative resource allocation for orthogonal frequency 
division multiplexing (OFDM) is studied. A game theoretic approach for relay selection has been proposed 
in [24]. In [25], the sensor nodes can cooperate to form longer range communication hnks so as to bypass 
the energy-depleting nodes. As a result, the network fife time can be greatly improved. In [26], centralized 
power allocation schemes are presented by assuming all the relay nodes helped. In [27], cooperative 
routing protocols are constructed based on non-cooperative routes. 

Using cooperative transmission, boundary nodes can serve as relays and provide some transmission 
benefits for the backbone nodes that can be viewed as source nodes. In return, the boundary nodes are 
rewarded for packet-forwarding. To analyze the benefits and rewards, we investigate a game coalition that 
describes how much collective payoff a set of nodes can gain and how to divide this payoff. We investigate 
the stability and payoff division using concepts such as the core, nucleolus, and Shapley function. Three 
types of fairness are defined, namely, the min-max fairness using nucleolus, average fairness using the 
Shapley function, and our proposed market value fairness. Market fairness is a new fairness concept 
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involving multiple backbone nodes and multiple boundary nodes, based on the specific problem treated 
in this paper. Then, we construct a protocol using both repeated games and coalition games. From the 
simulation results, we investigate how boundary nodes and backbone nodes form coalitions according to 
different fairness criteria. The proposed protocol can improve the network connectivity by about 50%, 
compared to the pure repeated game approach. 

This paper is organized as follows: In Section IHl repeated game approaches are reviewed and the curse 
of the boundary nodes is explained. In Section [nil the cooperative transmission model is illustrated and 
the corresponding coalition games are constructed. Stability and three types of fairness are investigated. 
A protocol that exploits the properties of our approach is also proposed. Simulation results are shown in 
Section JV] and conclusions are given in Section |Vl 

II. Repeated Games and the Curse of Boundary Nodes 

A wireless packet-forwarding network can be modeled as a directed graph G{L,A), where L is the 
set of all nodes and A is the set of all directed links £ L. Each node i has several transmission 

destinations which are included in set Di. To reach the destination j in Di, the available routes form 
a depending graph whose nodes represents the potential packet-forwarding nodes. The transmission 
from node i to node j depends on a subsect of the nodes in Gj for packet-forwarding. Notice that this 
dependency can be mutual. One node depends on the other node, while the other node can depend on 
this node as well. In general, this mutual dependency is common, especially for backbone nodes at the 
center of the network. In the remainder of this section, we will discuss how to make use of this mutual 
dependency for packet-forwarding using a repeated game, and then we will explain the curse of boundary 
nodes. 

A. Repeated Games for Mutually Dependent Nodes 

A repeated game is a special type of dynamic game (a game that is played multiple times). When the 
nodes interact by playing a similar static game (which is played only once) numerous times, the game 
is called a repeated game. Unlike a static game, a repeated game allows a strategy to be contingent on 
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the past moves, thus allowing reputation effects and retribution, which give possibiUties for cooperation. 
The game is defined as follows: 

Definition 1: A T-period repeated game is a dynamic game in which, at each period t, the moves 
during periods 1, . . . , t — 1 are known to every node. In such a game, the total discounted payoff for each 
node is computed by Y^l=i P*~^Ui{t), where Ui{t) denotes the payoff to node i at period t and where 
/3 is a discount factor. Note that (3 represents the node's patience or on the other hand how significantly 
the past affects the current payoff. If T = oo, the game is referred as an infinitely-repeated game. The 
average payoff to node i is then given by: 

oo 

Ui = {l-P)Y,P'~'uiit)- (1) 
t=l 

It is known that repeated games can be used to induce greedy nodes in communication networks to 
show cooperation. In packet-forwarding networks, if a greedy node does not forward the packets of other 
nodes, it can enjoy benefits such as power saving. However, this node will be punished by the other 
nodes in the future if it depends on the other nodes to forward its own packets. The benefit of greediness 
in the short term will be offset by the loss associated with punishment in the future. So the nodes will 
rather act cooperatively if the nodes are sufficiently patient. From the Folk theorem below, we infer that 
in an infinitely repeated game, any feasible outcome that gives each node a better payoff than the Nash 
equilibrium [1], [2] can be obtained. 

Theorem 1: {Folk Theorem [1], [2]) Let (ui, . . . ,ul) be the set of payoffs from a Nash equilibrium 
and let (tti, . . . , ul) be any feasible set of payoffs. There exists an equilibrium of the infinitely repeated 
game that attains any feasible solution (ui, . . . , ul) with Ui > Uiyi as the average payoff, provided that 
/? is sufficiently close to 1. 

In the literature of packet-forwarding wireless networks, the conclusion of the above Folk theorem 
is achieved by several approaches. Tit-for-tat [8] [10] is proposed so that all mutually dependent nodes 
have the same set of actions. A cartel maintenance scheme [11] has closed-form optimal solutions for 
both cooperation and non-cooperation. A self-learning repeated game approach is proposed in [12] for 
individual distributed nodes to study the cooperation points and to develop protocols for maintaining 
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them. Given the previous attention to the problem of nodes having mutual dependency, we will assume 
in this paper that the packet-forwarding problem of selfish nodes with mutual dependency has been solved 
and we will focus instead on the problems encountered by the boundary nodes. 

B. Curse of Boundary Nodes 

When there is no mutual dependency, the curse of boundary nodes occurs, an example of which is 
shown in Figure [T] Suppose node 1 needs to send data to node 3, and node 2 needs to send data to node 
0. Because node 1 and node 2 depend on each other for packet-forwarding, they are obUged to do so 
because of the possible threat or retaliation from the other node. However, if node wants to transmit to 
node 2 and node 3, or node 3 tries to communicate with node and node 1, the nodes in the middle have 
no incentive to forward the packets due to their greediness. Moreover, this greediness cannot be punished 
in the future since the dependency is not mutual. This problem is especially severe for the nodes on the 
boundary of the network, so it is called the curse of boundary nodes. 

On the other hand, if node can form a coalition with node 1 and help node I's transmission (for 
example to reduce the transmitted power of node 1), then node 1 has an incentive to help node transmit 
as a reward. A similar situation arises for node 3 to form a coalition with node 2. We call nodes like 1 
and 2 backbone nodes, while nodes like and 3 are boundary nodes. In the following section, we will 
study how coalitions can be formed to address this issue using cooperative transmission. 

III. Coalition Games with Cooperative Transmission 

In this section, we first study a cooperative transmission technique that allows nodes to participate 
in coalitions. Then, we formulate a coalition game with cooperative transmission. Furthermore, we 
investigate the fairness issue and propose three types of fairness definitions. Finally, a protocol for packet- 
forwarding using repeated games and coalition games is constructed. 
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A. Cooperative Transmission System Model 

First, we discuss the traditional direct transmission case. The source transmits its information to the 
destination with power P^. The received SNR is 

rd= ' 2 ' , (2) 

where hg^d is the channel response from the source to the destination and o"^ is the noise level. To achieve 
the minimal link quality 7, we need for the transmitted power to be sufficiently large so that > 7. 
The transmitted power is also upper bounded by Pmax- 

Next, we consider multiple nodes using the ampUfy-and-forward protocol [ivjll to transmit in two 
stages as shown in Figure |2l In stage one, the source node (denoted as node 0) transmits its information 
to the destination, and due to the broadcast nature of the wireless channels, the other nodes can receive 
the information. In stage two, the remaining relay nodes help the source by amplifying the source 
signal. In both stages, the source and the relays transmit their signals through orthogonal channels using 
schemes Uke TDMA, FDMA, or orthogonal CDMA. 

In stage one, the source transmits its information, and the received signals at the destination and the 
relays can be written respectively as 

ys,d = \/Pbhs4X + Us^d, (3) 

and ys,r. = \fPQhs,r,x + n^^r^, Vi e {1, . . . , iV}, (4) 

where Pq is the transmitted power of the source, x is the transmitted symbol with unit power, hg^n is 
the channel gain from the source to relay i, and ng^d and are noise processes at the destination and 
relay, respectively. Without significant loss of generality, we assume that all noises have the same power 

In stage two, each relay amplifies the received signal from the source and retransmits it to the 

'other cooperative transmission protocols can be exploited in a similar way. 
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destination. The received signal at the destination for relay i can be written as 

yn4 = ,„ ^ K,4ys,r, + rir^d, (5) 

where Pi is relay i's transmit power, hr^^d is the channel gain from relay i to the destination, and n^.^d 
is noise with variance cj^. 

At the destination, the signal received at stage one and the signals received at stage two are combined 
using maximal ratio combining (MRC). The SNR at the output of MRC is 

N 

r = ro + ^r„ (6) 

i=l 

where Tq = '^"^^2''' and 

-p _ PoPi\hs,ri\'^\hri,d\'^ 

On comparing Q with in order to achieve the desired link quality 7, we can see that the required 
power is always less than the direct transmission power, i.e., Pq < Pj. So cooperation transmission can 
reduce the transmit power of the source node. This fact can give incentives of mutual benefits for the 
backbone nodes (acting as sources) and the boundary nodes (acting as relays), and consequently can cure 
the curse of the boundary nodes mentioned in Section III-BI 

B. Coalition Game Formation for Boundary Nodes 

In this subsection, we study possible coalitions between the boundary nodes and the backbone nodes, 
for situations in which the boundary nodes can help relay the information of the backbone nodes using 
cooperative transmission. In the following, we first define some basic concepts that will be needed in our 
analysis. 

Definition 2: A coalition S is defined to be a subset of the total set of nodes N = {0, . . . , A^}. The 
nodes in a coalition want to cooperate with each other. The coalition form of a game is given by the 
pair (N, v), where w is a real-valued function, called the characteristic function. v{S) is the value of the 
cooperation for coalition S with the following properties: 

1) t;(0) = 0. 
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2) Super-additivity: if S and Z are disjoint coalitions {Sf]Z = 0), then v{S) + v{Z) < v{S[jZ). 

The coaUtion states the benefit obtained from cooperation agreements. But we still need to examine 
whether or not the nodes are willing to participate in the coalition. A coalition is called stable if no other 
coalition will have the incentive and power to upset the cooperative agreement. Such division of v is 
called a point in the core, which is defined by the following definitions. 

Definition 3: A payoff vector U = {Uq, . . . , Un) is said to be group rational or efficient if YliLo — 
u(N). A payoff vector U is said to be individually rational if the node can obtain the benefit no less than 
acting alone, i.e. Ui > v{{i}), Vi. An imputation is a payoff vector satisfying the above two conditions. 

Definition 4: An imputation U is said to be unstable through a coalition S if v{S) > J^ieS^i^ 
the nodes have incentive for coalition S and upset the proposed U. The set C of a stable imputation is 
called the core, i.e., 

C = {U : ^ C/i = t;(N) and ^Ui> v{S), V5 C N}. (8) 
In the economics literature, the core gives a reasonable set of possible shares. A combination of shares 
is in the core if there is no sub-coalition in which its members may gain a higher total outcome than 
the combination of shares of concern. If a share is not in the core, some members may be frustrated and 
may think of leaving the whole group with some other members and form a smaller group. 

In the packet-forwarding network as shown in Figure |2l we first assume one backbone node to be the 
source node (node 0) and the nearby boundary nodes (node 1 to node N) to be the relay nodes. We will 
discuss the case of multiple source nodes later. If no cooperative transmission is employed, the utilities 
for the source node and the relay nodes are 

vi{0}) = -Pd, andviii}) =-^yi = l,...,N. (9) 

Here a utility of — oo means that even though a boundary user tries to use maximal power for transmission, 
it cannot successfully deliver any packets due to the curse. 
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With cooperative transmission and a grand coalition that includes all nodes, the utilities for the source 
node and the relay nodes are 

N 

Uo = -Po-J2'^^Pd (10) 

1=1 

andUi = - — , (11) 

ai 

where is the ratio of the number of packets that the backbone node is willing to forward for 
boundary node i, to the number of packets that the boundary node i relays for the backbone node 
using cooperative transmission. Smaller Oj means the boundary nodes have to relay more packets before 
realizing the rewards of packet forwarding. The other interpretation of the utiUty is as the average power 
per transmission for the boundary nodefl The following theorem gives conditions under which the core 
is not empty, i.e, in which the grand coalition is stable. 

Theorem 2: The core is not empty if > 0, i = 1, . . . ,N , and are such that Uq > v{{0}), i.e, 

1=1 

Proof: First, any relay node will get — oo utility if it leaves the coalition with the source node, so 
no node has incentive to leave the coalition with node 0. Then, from the inclusion of relay nodes 
will increase the received SNR monotonically. So Pq will decrease monotonically with the addition of 
any relay node. As a result, the source node has an incentive to include all the relay nodes, as long as 
the source power can be reduced, i.e., Uq > v{{0}). A grand coalition is formed and the core is not 
empty if ([HI) holds. ■ 
The concept of the core defines the stability of a utility allocation. However, it does not define how to 
allocate the utility. For the proposed game, each relay node can obtain different utilities by using different 
values of a^. In the next three subsections, we study how to achieve min-max fairness, average fairness, 
and market fairness. 

^Notice that we omit the transmitted power needed to send the boundary node's own packet to the baclcbone node, since it 
is irrelevant to the coalition. 
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C. Min-Max Fairness of a Game Coalition using Nucleolus 

We introduce the concepts of excess, kernel, and nucleolus [1], [2]. For a fixed cliaracteristic function 
V, an imputation U is found such that, for each coaUtion S and its associated dissatisfaction, an optimal 
imputation is calculated to minimize the maximum dissatisfaction. The dissatisfaction is quantified as 
follows. 

Definition 5: The measure of dissatisfaction of an imputation U for a coalition S is defined as the 
excess: 

e{\J,S) = v{S)-J2Uj- (13) 
Obviously, any imputation U is in the core, if and only if all its excesses are negative or zero. 
Definition 6: A kernel of v is the set of all allocations U such that 

max e(U, 5) = max e(U, T). (14) 

5CN-j,ieS' TCN-j,iGT 

If nodes i and j are in the same coalition, then the highest excess that i can make in a coalition without 
j is equal to the highest excess that j can make in a coalition without i. 

Definition 7: The nucleolus of a game is the allocation U that minimizes the maximum excess: 

U = argniin(max e(U,5), \/S). (15) 
The nucleolus of a game has the following property: The nucleolus of a game in coahtional form exists 
and is unique. The nucleolus is group rational and individually rational. If the core is not empty, the 
nucleolus is in the core and kernel. In other word, the nucleolus is the best allocation under the min-max 
criterion. 

Using the above concepts, we prove the following theorem to show the optimal Oj in (ITOl ) to have 
min-max fairness. 

Theorem 3: The maximal a-i to yield the nucleolus of the proposed coalition game is given by 

Pd-Pom .... 

a, = , (Id) 

where Po(N) is the required transmitted power of the source when all relays transmit with transmitted 

power Pmax- 
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Proof: Since for any coalition other than the grand coalition, the excess will be —oo, we need only 
consider the grand coalition. Suppose the min-max utility is ji for all nodes, i.e. 

Pi 

^ = -■ (17) 

From ([T2I1 and since Ui is monotonically increasing with ai in (fTTI ). we have 

_ « . (ft -p.). (18) 

Since Pq in ((61) is a monotonically increasing function of Pi, to achieve the maximal and each relay 
transmits with the largest possible power Pmax- Notice here we assume the backbone node can accept 
arbitrarily small power gain to join the coalition. ■ 

D. Average Fairness of Game Coalition using the Shapley Function 

The core concept defines the stability of an allocation of payoff and the nucleolus concept quantifies the 
min-max fairness of a game coalition. In this subsection, we study another average measure of fairness 
for each individual using the concept of a Shapley function [1], [2]. 

Definition 8: A Shapley function ^ is a function that assigns to each possible characteristic function 
V a vector of real numbers, i.e., 

<P{v) = {Mv),Mv),Mv),---,^n(v)) (19) 

where (j)i{v) represents the worth or value of node i in the game. There are four Shapley Axioms that 
(l){v) must satisfy 

1) Efficiency Axiom: = v(N). 

2) Symmetry Axiom: If node i and node j are such that v{S[j{i}) = v{S[j{j}) for every coalition 
S not containing node i and node j, then (^{{v) = (pjiv). 

3) Dummy Axiom: If node i is such that v{S) = v{S[j{i}) for every coalition S not containing i, 
then 4'i{v) = 0. 

4) Additivity Axiom: If u and v are characteristic functions, then (p{u + v) = + u) = (l){u) + 4>{v). 
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It can be proved that there exists a unique function (f) satisfying the Shapley axioms. Moreover, the 
Shapley function can be calculated as 



Here l^l denotes the size of set S and N = {0, 1, . . . N}. 

The physical meaning of the Shapley function can be interpreted as follows. Suppose one backbone 
node plus N boundary nodes form a coahtion. The nodes join the coalition in random order. So there 
are {N + l)\ different ways that the nodes might be ordered in joining the coalition. For any set S 
that does not contain node i, there are |S'|!(A'^ — IS"!)! different ways to order the nodes so that S is 
the set of nodes that enter the coalition before node i. Thus, if the various orderings are equally likely, 
|S'|!(iV — |S'|)!/(A^ + 1)! is the probability that, when node i enters the coalition, the coalition of S is 
akeady formed. When node i finds S ahead of it as it joins the coalition, then its marginal contribution to 
the worth of the coahtion is v{SU {i}) — v{S). Thus, under the assumption of randomly-ordered joining, 
the Shapley function of each node is its expected marginal contribution when it joins the coalition. 

In our specific case, we consider the case in which the backbone node is always in the coalition, and 
the boundary nodes randomly join the coahtion. We have f ({0}) = —Pd and 



which is the overall power saving. The problem here is how to find a given node's ai that satisfies the 
average fairness, which is addressed by the following theorem. 

Theorem 4: The maximal that satisfies the average fairness with the physical meaning of the Shapley 
function is given by 




(20) 




(21) 




(22) 



where P? is the average power saving with random entering orders, which is defined as 




(23) 
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Proof: The maximal ai is solved by the following equations: 

(24) 



aj <j>i_ 

Qj ~ 4>j ■ 



v{n) > 0. 

The first equation in (I24b is the average fairness according to the Shapley function, and the second 
equation in ((24l) is the condition for a non-empty core. Similar to min-max fairness, we assume that the 
backbone node can accept arbitrarily small power gain to join the coalition. 

If boundary node i is the first to join the coalition, the marginal contribution for power saving is 
jf[Pd — Po{{i}) — OiPd], where is the probability. If boundary node i is the second to join the 

coahtion, the margmal contribution is — -"^ n{N-i) • means of some simple 

derivations, we can obtain the Shapley function 0i as 

(/-i = -aiPd + T^I^rf - Mb})] + N{N-1) ' ^ ^ 



and then we can obtain 



Since 



ai = . (26) 



N 



Prf-Po(N) = J^P/, (27) 

we prove (l22l) . ■ 
Notice that different nodes have different values of Pf, due to their channel conditions and abilities 
to reduce the backbone node's power. Compared with the min-max fairness in the previous subsection, 
the average fairness using the Shapley function gives different nodes different values of according to 
their locations. 

E. Market Fairness of Game Coalition with Multiple Backbone Nodes 

In the previous two subsections, we have discussed two types of fairness with one backbone node and 
multiple boundary nodes. However, since the boundary nodes depend entirely on the backbone node for 
packet forwarding, the backbone node can disregard the fairness and coerce the boundary nodes by asking 
for an arbitrary amount of payoff before helping the boundary nodes send their packets. The backbone 
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node can join the coalition only if v{N) > vq, where vq is a positive value. So the in ([T6l ) and (l22l ) 
becomes 

{ ^''~^°(^')~'"" min-max fairness 

,p_/'_ ip, (28) 
P.fi-Po(N)P ' average fairness. 

Thus, a greedy backbone node can increase vq sufficiently large so that the boundary nodes receive 
arbitrarily small Oj. This means that the backbone node can arbitrarily impose on the boundary nodes for 
relaying and almost never give rewards in return. The underlying reason for this is because the backbone 
node has no competition from other nodes. In economic networks, this phenomena is called "monopoly" 
and the consumer suffers a minimal quality of services as a result. 

To solve this problem, we discuss the case in which there are multiple backbone nodes, which is similar 
to "antitrust" in economic networks. First, we prove the following theorem for the core with multiple 
backbone nodes. 

Theorem 5: If the number of backbone nodes is greater than 1, the core is surely empty. 

Proof: Suppose there are M backbone nodes. There is no mutual benefit between these backbone 
nodes to form coalitions using cooperative transmission. The boundary nodes join the coalitions that give 
them the highest payoff, i.e., they seek coalitions that allow them to relay the fewest packets before a 
reward for packet forwarding is given. So the grand coalition is divided into M coaUtions, since there 
are benefits for a subset of nodes to form the new coalition instead of joining the grand coalition. As a 
result, the core is surely empty when M > 2. ■ 
Since the grand coalition does not exist and the boundary nodes can select the backbone nodes with 
which to form coalitions, it is to the backbones nodes' benefits to adjust the packet-forwarding policy 
to attract more boundary nodes to reduce the transmitted power. So competition among the backbone 
nodes is introduced. Here we denote a™ as the m*^ backbone node's packet-forwarding policy for the 
i*^ boundary node, and denote the nodes' coalition partition matrix as 

1, if boundary node i joins coalition with backbone node m, 

(29) 

0, otherwise. 

Boundary node i selects the smallest a™ and joins the corresponding coalition with backbone node m. 
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The optimal utility is obtained when the packets are relayed only by this backbone node. So we have 

M 

^ Aim = 1, Aim e {0, l},Vi,m. (30) 

m=l 

For each backbone node, the optimization is to adjust its poUcy so that the overall power saving 
is largest. We can write the utility for the m!'^ backbone node as 



= max{-P^ - V aTAimPd), (31) 

a™ ,Vi ^ — ' 

i=l 

where Pq" is the reduced transmitted power using cooperative transmission. 

For each boundary node, the optimization is to select the backbone node to join the coalition. The 
problem can be written as 

Pi 

Ui = max — \ — (32) 



M 



s.t. ^ Aim = I, Aim G {0, 1}, Vm. 



m=l 

In order for a backbone node to win the coalition with a boundary node, the backbone node has to set 
the lowest af^ among all the backbone nodes. On the other hand, different boundary nodes have different 
abilities to reduce different backbone nodes' power. Using these facts, we define a new type of fairness 
as follows. 

Definition 9: Market fairness achieves the equilibrium of the two-level games in (OTI ) and (l32l) . In 
this type of fairness, no backbone node can set its policy lower to get a higher utility if the other 
backbone nodes do not change their policies. On the other hand, it is in the boundary nodes' best interest 
to join the coalitions under this market fairness. 

In Figure [3j we show an example of market fairness for a two-backbone-node and one-boundary-node 
example. The x-axis and y-axis are the two backbone nodes' policies a\ and af, respectively. Below 
the 45 degree line, a\ < a\. As a result, the boundary node joins the coalition with backbone node 1, 
i.e.. All = 1 and A12 = 0. Otherwise, the boundary node forms a coalition with backbone node 2, i.e.. 
All = and A12 = 1. From (fTTl) . the utility is a linear function of the policy a™, m = 1,2. For a 
backbone node, the minimal requirement for joining the coalition is that its power is less than the direct 
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transmission power. In Figure |3l we show the a™ for Uq^ = —Pd,m = 1,2. Since different boundary 
nodes can help reduce the backbone nodes' transmission power differently, different values of a™ 
are required to achieve C/™ = —Pd- In our case, backbone node 1 is the winner by providing a\ = a\ 
and its utility gain is Pd — P^ — dfPd- Notice that backbone node 1 cannot let a\ < af, since backbone 
node 2 then has the ability to give lower to attract the boundary node. On the other hand, as long 
as a\ > af, backbone node 1 has no incentive to increase a\. From this example, we can see that the 
backbone nodes have to offer high enough to form coalitions with the boundary nodes, because of 
the competition with other backbone nodes. 

Notice that the cooperative transmission power Pq" depends on which boundary nodes join the coalition, 
i.e., Pq" is a function of vector [Aim, • • • ,^Nm\- In order to find the point with market fairness, we 
formulate the following programming method. 



M / N \ 

min V Po™(Aim, . . . , Aivm) + V a^A.^Prf , (33) 

R5",o™>0,Vi,m ^ — ' \ ^ — ' / 
m=l \ i=l / 



S.t. 



yi,Aim = 1, if a™ > Q^r' ^^'^ / "'-lAjm = 0, otherwise, 
Vm,Po-(Ai„, . ..ANm) + Eili aT^tmPd < Pd- 
Here the first constraint is Boundary Node Rationality, which means the boundary node will select the 

optimal a™. The second constraint is Backbone Node Rationality, which states that the backbone nodes 

will only join a coalition if their power can be reduced by doing so. The objective function captures the 

phenomenon that the backbone nodes will maximize their utilities by reducing as much as possible. 

The problem in (1331 ) can be efficiently solved by algorithms such as the cutting-plane and simplex 

algorithms [28], [29]. The problem can be solved by either the backbone node or the boundary node, 

since the outcome can benefit both nodes. 

F. Joint Repeated-Game and Coalition-Game Packet-Forwarding Protocol 

Using the above analysis, we now develop a packet-forwarding protocol based on repeated games and 
coalition games having on the following steps. 
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Packet-Forwarding Protocol using Repeated Games and Coalition Games 

1) Route discovery for all nodes. 

2) Packet-Forwarding enforcement for the backbone nodes, using threat of future punishment in the 
repeated games. 

3) Neighbor discovery for the boundary nodes. 

4) Coahtion game formation. 

5) Packet relay for the backbone nodes with cooperative transmission. 

6) Transmission of the boundary nodes' own packets to the backbone nodes for forwarding. 

First, all nodes in the network undergo route discovery. Then each node knows who depends on it and 
on whom it depends for transmission. Using this route information, the repeated games can be formulated 
for the backbone nodes. The backbone nodes forward the other nodes' information because of the threat 
of future punishment if these packets are not forwarded. Due to the network topology, some nodes' 
transmissions depend on the others while the others do not depend on these nodes. These nodes are most 
often located at the boundary of the network. In the next step, these boundary nodes try to find their 
neighboring backbone nodes. Then, the boundary nodes try to form coaUtions with the backbone nodes, 
so that the boundary nodes can be rewarded for transmitting their own packets. Cooperative transmission 
gives an opportunity for the boundary nodes to pay some "credits" first to the backbone nodes for 
the rewards of packet-forwarding in return. On the other hand, competition among the backbone nodes 
prevents the boundary nodes from being forced to accept the minimal payoffs. 

It is worth mentioning the following point regarding energy efficiency. From the overall system point of 
view, it is not energy efficient for the backbone nodes to depend on the boundary nodes for cooperation, 
since the boundary nodes are further away from the backbones' destination. If a centrahzed control system 
is enforced, it is energy efficient for the backbone nodes to forward the packets of the boundary nodes. 
However, if distributed and greedy users are considered, the curse happens. Our approach provides the 
incentives for the backbone nodes to help the boundary nodes, so that the curse is reheved. But this comes 
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with a cost, in the sense that the boundary nodes have to help the backbone nodes in an energy-inefficient 
way. Nevertheless, this is already much better than the totally accursed situation in which no packet of 
the boundary nodes can be transmitted. 

Another implementation concern arises from node mobility. The proposed algorithm is similar to a 
contract. As long as the boundary nodes help the transmission and the backbone nodes help the packet 
forwarding, the contract is fulfilled. This can happen with transmission of 1 + ^ packets. If mobility is 
considered, the new contract needs to be calculated to accounts for the new positions of the nodes. As 
long as the speed of fulfilling the contract is relatively larger than the speed of channel changing, the 
proposed scheme can be implemented without major modification. Nevertheless, if the channel changes 
too rapidly, some stochastic models can be used to estimate the expected payoff (utility). Then the rest 
of the analysis can be applied in a very similar way. 

IV. Simulation Results 

We model all channels as additive white Gaussian noise channels having the exponent of propagation 
loss as 3; that is, power falls off spatially according to an inverse-cubic law. The maximal transmitted 
power is lOdbm and the noise level is - 60dbm. The minimal SNR 7 is lOdB. In the first setup, we 
assume the backbone node is located at (Om,Om), and the destination is located at either (100m, Om) 
or (50m, Om). The boundary nodes are located on an arc with angles randomly distributed from O.Svr to 
1.5tt and with distances varying from 5m to 100m. 

In Figure m we study the min-max fairness and show the average over 1000 iterations as a function 
of distance from the relays to the source node. Due to the min-max nature, all boundary nodes have the 
same Oj. When the distance is small, i.e., when the relays are located close to the source, Ui approaches 
j^. This is because the relays can serve as a virtual antenna for the source, and the source needs very 
low power for transmission to the relays. When the distance is large, the relays are less effective and 
decreases, which means that the relays must transmit more packets for the source to earn the rewards of 
packet-forwarding. When the destination is located at 50m, the source-destination channel is better than 
that at 100m. When N = 1 and the source-destination distance is 50m, the relays close to the source 
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have larger values of Oj and the relays farther away have lower values of than that in the 100m case. 
In Figure [51 we show the corresponding Pq for the backbone node. We can see that Pq increases when 
the distances between the boundary nodes to the backbone node increase. 

If we consider the multiple backbone (multiple core) case with min-max fairness, Figure |4] and Figure 
[5] provide the boundary nodes a guideline for selecting a backbone node with which to form a coalition. 
First, a less crowded coalition is preferred. Second, the nearest backbone node is preferred. Third, for 

= 1, if the source-destination channel is good, the closer backbone node is preferred; otherwise, the 
farther one can provide larger a,. 

Next, we investigate the average fairness using the Shapley function. The simulation setup is as follows. 
The backbone node is located at (Om, Om) and the destination is located at (—50m, Om). Boundary node 
1 is located at (20m, Om) or (50m, Om). Boundary node 2 moves from (5m, Om) to (100m, Om). The 
remaining simulation parameters are the same. In Figure [6l we show maximal for two boundary nodes. 
We can see that when boundary node 2 is closer to the backbone node than boundary node 1, 02 > «!> 
i.e., boundary node 2 can help relay fewer packets for backbone node 1 before being rewarded. The two 
curves for ai and a2 for the same boundary node 1 location cross at the boundary node 1 location. The 
figure shows that the average fairness using the Shapley function gives greater rewards to the boundary 
node whose channel is better and who can help the backbone node more. When boundary node 2 moves 
from (20m, Om) to (50m, Om), ai becomes smaller, but 02 becomes larger. This is because the backbone 
node must depend on boundary node 2 more for relaying. However, the backbone node will pay less for 
the boundary nodes. Notice that ai at the crossover point is lower. This is because the overall power for 
the backbone node is high when boundary node 2 is far away, as shown in Figure HI 

Further, we study market fairness with the following setup. Backbone node 1 and backbone node 2 
are located at (Om, —30m) and (Om, 30m), respectively. The destination is located at (— 50m,0m) and 
boundary node 1 is located at (44m, 10m). Boundary node 2 moves from (44m, —50m) to (44m, 50m). 
The remaining simulation parameters are the same as before. In Figure [8] and Figure |9j we show and 
P^, respectively, under six different scenarios: 
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1) (2,1): Coalition of boundary node 2 with backbone node 1; 

2) (2,2): Coalition of boundary node 2 with backbone node 2; 

3) (1,1): Coalition of boundary node 1 with backbone node 1; 

4) (1,2): Coalition of boundary node 1 with backbone node 2; 

5) ([1;2],1): Coalition of both boundary nodes with backbone node 1; 

6) ([1;2],2): Coalition of both boundary nodes with backbone node 2. 

Since boundary node 1 is not moving, coalition (1,1) and coalition (1,2) are horizontal lines. From the 
curves in Figure [H we can see that a boundary node prefers to form a coalition with the closest backbone 
node, and vice versa. However, due to competition from the other nodes, the coalition formation is affected 
by combinations of many factors which are analyzed as follows. 

When boundary node 2 moves, there are seven possible scenarios for forming different coalitions in 
Table H From Figure [8] and Table H we can see that rational boundary node i selects the largest af^ 
and joins the corresponding coalition with backbone node m. Sometime, it is to both boundary nodes' 
benefit to form a coalition with one of the backbone nodes as in case II and case VI. However, because 
the backbone nodes are greedy, the boundary nodes can obtain only slightly better rewards than the 
opponent's offer. For example, in case I, boundary node 1 prefers backbone node 2. But as long as the 
backbone node gives an offer better than a\, boundary node 1 must accept the offer. On the other hand, 
from Figure |9j the backbone nodes want to form coalitions with both boundary nodes so as to have the 
minimal transmitted power. But because of competition from other backbone nodes and rationality of the 
boundary nodes, the backbone nodes must form a coalition with only one boundary node or sometime 
not at all. The above facts demonstrate the reason why the proposed market fairness can effectively 
counteract the greediness of the backbone nodes. 

Next, we set up a linear network with 50 nodes spread evenly along a line. The distance between nodes 
is 100m. The users are indexed as user 1 to user 50 from one end to the other. Each user transmits to any 
other user with equal probability. In Figure [TOl we show the probability that a node can be a boundary 
node as a function of the user index. We show two cases with one destination and five destinations for 
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each user, respectively. We can see that the nodes in the middle of the network have lower probabilities 
to become boundary nodes, as one would expect. As a result, a for those nodes is large, which means 
those nodes take less on average to help the others' transmission, because of their locations. For the five 
destination case, each user transmits to five different destination nodes, and as a result depends more on 
the other nodes. So the nodes in the middle have much lower probability to be boundary nodes than in 
the one-destination case. 

Finally, we examine the degree to which the coalition game can improve the network connectivity. 
Here we define the network connectivity as the probability that a randomly located node can connect 
to the other nodes. All nodes are randomly located within a square of size B x B. \vi Figure [TT] we 
show the network un-connectivity as a function of B for the numbers of nodes equal to 100 and 500. 
With increasing network size, the node density becomes lower, and more and more nodes are located 
at the boundary and must depend on the others for packet-forwarding. If no coaUtion game is formed, 
these boundary nodes cannot transmit their packets due to the selfishness of the other nodes. With the 
coalition game, the network connectivity can be improved by about 50%. The only chance that a node 
cannot connect to the other nodes is when this node is located too far away from any other node. Thus, 
we can seen by this example that the coalition game can cure the curse of the boundary nodes in wireless 
packet-forwarding networks with selfish nodes. 

V. Conclusions 

In this paper, we have proposed a coalition game approach to provide incentives to selfish nodes 
in wireless packet-forwarding networks using cooperative transmission, so that the boundary nodes can 
transmit their packets effectively. We have used the concepts of coalition games to maintain stable and fair 
game coalitions. Specifically, we have studied three fairness concepts: min-max fairness, average fairness, 
and market fairness. The market fairness uses competition among nodes to effectively counteract the 
greediness of the backbone nodes. A protocol has been constructed using repeated games and coalition 
games. From simulation results, we have seen how boundary nodes and backbone nodes form coalitions 
according to different fairness criteria. We have also seen by example that network connectivity can be 
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improved by about 50%, compared to the pure repeated game approach. 
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Fig. 5: Po for Different Channels and No. of Nodes, Min-Max Fairness 
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TABLE I: Market Fairness Coalitions 



Case 


Coalition (optimal for boundary node) 


Minimal a offered by backbone node 


I 


(1,2),(2,1) 


1 „2 

"i,a2 


II 


([i;2],i) 


2 2 
"1,02 


III 


(2,1),(1,2) 


1 2 

"i,a2 


IV 


(1,2),(2,1) 


1 „2 
"1,02 


V 


(2,2),(1,1) 


2 „1 
"1,02 


VI 


([1;2],2) 


"1,«2 


VII 


(1,2),(2,1) 


„1 „2 

"i,a2 
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